Claims 

1 LA method for stereo image processing of an object, the method comprising 

2 the steps of: 

3 obtaining at least a pair of stereo images each having a plurality of pixels, said 

4 stereo images being a digital representation of a corresponding pair of 

5 stereo radiographs taken of the object; 

6 correcting illumination errors within the pair of stereo images; 

7 removing distortions from the pair of stereo images; 

8 combining pixels of the pair of stereo images into a composite image; and 

9 adjusting a corresponding screen parallax for the composite image. 

1 2. The method of Claim 1, wherein the step of correcting illumination errors 

2 comprises the substeps of: 

3 selecting a first group of pixels from a first image of the pair of stereo images; 

4 selecting a second group of pixels from a second image of the pair of stereo 

5 images, the second group of pixels being respectively associated with 

6 the first group of pixels; 

7 determining an intensity level for each pixel in both groups of pixels; 

8 determining a mean intensity level and a variance for each of the first and second 

9 groups of pixels; 
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equalizing the mean intensity level and the variance of the first group and the 
second group; and 

adjusting the pixels to equalize the mean intensity level and the variance of the 
first group and the second group. 

3. The method of Claim 2, wherein the substep of equalizing the mean intensity 
level and the variance comprises the further substeps of: 

determining a new intensity level for a first pixel and a second pixel, the first 

pixel being in the first group and the second pixel being in the second 
group, the new intensity level being between the intensity level of the 
first pixel and the intensity level of the second pixel; and 

altering the intensity levels of the first and second pixels to be the new intensity 
level. 

4. The method of Claim 2, wherein the intensity level determined for each pixel 
comprises grayscale values. 

5. The method of Claim 2, wherein the pair of stereo radiographs is obtained by 
an X-ray imaging device, the X-ray imaging device being moved between times when a 
first radiograph of the pair of stereo radiographs and a second radiograph of the pair of 
stereo radiographs are obtained. 

6. The method of Claim 5, wherein the substep of selecting a first group of 
pixels comprises the further substep of: 

selecting a plurality of pixels forming a line perpendicular to a direction of 
motion of the X-ray imaging device. 
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1 7. The method of Claim 5, wherein the substep of selecting a first group of 

2 pixels comprises the further substep of: 

selecting a plurality of pixels forming a longitudinal line perpendicular to a 

direction of motion of the X-ray imaging device at a point where the 
longitudinal line intersects a direction of motion of the X-ray imaging 
device. 

1 8. The method of Claim 1, wherein the stereo radiographs comprise X-ray 

2 images. 

9. The method of Claim 1, wherein the step of correcting illumination errors 
comprises the substeps of: 

selecting a first group of pixels from a first image of the pair of stereo images; 

selecting a second group of pixels from a second image of the pair of stereo 
images; 

determining a first mean intensity value and a first variance for the first group of 
pixels; 



8 determining a second mean intensity value and a second variance for the second 

9 group of pixels; 

10 equalizing the first mean intensity value and first variance with the second mean 

11 intensity value and second variance, respectively; and 

12 adjusting at least one of the first group of pixels and the second group of pixels 

13 in response to the substep of equalizing the first mean intensity value 
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and first variance with the second mean intensity value and second 



variance. 
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10. The method of Claim 9, wherein the substep of adjusting at least one of the 
group of pixels and the second group of pixels comprises the further substep of: 

adjusting pixel intensities for the first group of pixels such that the first mean 
intensity value is equal to the second mean intensity value. 

1 1 . The method of Claim 9, wherein the substep of adjusting at least one of the 
group of pixels and the second group of pixels comprises the further substep of: 

adjusting pixel intensities for the second group of pixels such that the second 
mean intensity value is equal to the first mean intensity value. 

12. The method of Claim 9, further comprising the substeps of: 

determining a third mean intensity value by adjusting pixel intensities of the first 
group of pixels, wherein said third mean intensity value is between 
the first mean intensity value and the second mean intensity value; 

adjusting the first mean intensity value to be equal to the third mean intensity 
value; and 

adjusting the second mean intensity value to be equal to the third mean intensity 
value. 
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7 13. The method of Claim 1 , wherein the step of removing distortions comprises 

2 the substeps of: 

3 removing depth plane curvature amongst the pair of stereo images; and 

4 removing keystone distortion amongst the pair of stereo images. 

1 14. The method of Claim 13, wherein the substep of removing depth plane 

2 curvature comprises the further substeps of: 



determining a representation of the pair of stereo images, the representation 

having a parallel geometry with respect to one or more X-ray sources 
used to form the radiographs; and 

determining pixel values for the representation based on the plurality of pixels in 
the pair of stereo images. 

15. The method of Claim 13, wherein the substep of removing keystone 
distortion comprises the substeps of: 

determining epipolar geometry amongst the pair of images; and 



4 shifting the pixels to remove the keystone distortion based on the epipolar 

5 geometry determined. 

1 16. The method of Claim 15, wherein the substep of determining epipolar 

2 geometry comprises the substeps of: 

3 creating a left and right search column on at least one of the pair of stereo 

4 images, wherein the pair of stereo images includes at least some 
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5 overlap area and at least one of the columns includes at least part of 

6 the overlap area; 

7 creating two sets of gray-scale sub-images, one set of the sub-images for each of 

8 the pair of stereo images; 

9 running a matching algorithm on each point in the right and left search column of 
10 each sub-image pair; 

/; calculating a vertical shift between points identified as matching by the matching 
12 algorithm; 

.as* 

yp 13 selecting points with identical vertical shift values; and 

SJ 

14 aligning the points that were not selected in the images by interpolating amongst 

HI 

: 15 vertical shift values for each column. 

H 

%. 1 17. The method of Claim 13, wherein the object comprises at least one item 

H 2 disposed therewithin, and wherein the substep of removing keystone distortions includes 

^ 3 further substeps, comprising: 

4 determining a location of at least one physical pointer disposed around the 

5 object, said physical pointer being captured in the pair of radiographs 

6 and represented in the pair of stereo images; 

7 estimating epipolar geometry and horizontal and vertical distortions using the 

8 location of the physical pointer in the pair of stereo images; and 

9 adjusting at least one image of the pair of stereo images vertically and 
10 horizontally to correct for any estimated distortions. 
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7 18. The method of Claim 17, further comprising the substep of calculating a 

2 location of the item. 

7 19. The method of Claim 17, wherein the physical pointer comprises an ink 

2 mark. 

7 20. The method of Claim 1 7, wherein the physical pointer comprises a metal 

2 ball. 

7 21. The method of Claim 1 7, wherein the physical pointer comprises a foil 

2 sticker. 

7 22. The method of Claim 17, wherein the physical pointer is disposed within the 

2 object. 

7 23. The method of Claim 1, wherein the object comprises at least one item, and 

2 the step of removing distortions from the pair of stereo images includes substeps for 

3 adjusting the radiographs, the substeps comprising: 

4 locating at least one physical pointer disposed around the object; 

5 capturing the pair of stereo radiographs using a radiograph imaging device, 

6 wherein the physical pointer is captured in the pair of radiographs; 

7 determining a location of the physical pointer; 

8 estimating geometry and horizontal and vertical distortions using the location of 

9 the physical pointer appearing in the pair of stereo images; and 

10 adjusting at least one image of the pair of stereo images vertically and 

77 horizontally to correct for any estimated distortions. 
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1 24. The method of Claim 23, wherein the physical pointer is disposed within the 

2 object, and the geometry includes epipolar geometry. 

1 25. The method of Claim 23, wherein the object comprises a body, and the item 

2 is selected from the group comprising a bullet, bone, muscle and tissue. 

1 26. The method of Claim 1 , wherein the step of adjusting a corresponding screen 

2 parallax comprises the substeps of: 

3 displaying the composite image on a display device, the display device including 

4 a viewing surface; and 

5 locating the object in the composite image near the viewing surface in order to 

6 minimize depth range. 

1 27. A computer-implemented method for stereo image processing of at least one 

2 pair of stereo images of an object, wherein the pair of stereo images includes a plurality 

3 of pixels and is obtained from a pair of stereo radiographs taken of the object, the 

4 method comprising the steps of: 

5 correcting illumination errors within the pair of stereo images; 

6 removing distortions from the pair of stereo images; and 

7 adjusting a corresponding screen parallax for a composite image, the composite 

8 image being a combination of the pixels of the pair of stereo images. 

1 28. The computer-implemented method of Claim 27, wherein the step of 

2 correcting illumination errors comprises the substeps of: 

3 selecting a first group of pixels from a first image of the pair of stereo images; 
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selecting a second group of pixels from a second image of the pair of stereo 
images, the second group of pixels being associated with the first 
group of pixels; 



determining an intensity level for each pixel in both groups of pixels; 

determining a mean intensity level and a variance for each of the first and second 
groups of pixels; 

equalizing the mean intensity level and the variance of the first group and the 
second group; and 

adjusting the pixels to equalize the mean intensity level and the variance of the 
first group and the second group. 

29. The computer-implemented method of Claim 28, wherein the substep of 
equalizing the mean intensity level and the variance comprises the further substeps of: 

determining a new intensity level for a first pixel and a second pixel, the first 

pixel being in the first group and the second pixel being in the second 
group, the new intensity level being between the intensity level of the 
first pixel and the intensity level of the second pixel; and 

altering the intensity level of the first and second pixels to be the new intensity 
level. 



30. The computer-implemented method of Claim 28, wherein the second group 
of pixels is selected according to a matching algorithm. 

31. The computer-implemented method of Claim 28, wherein the second group 
of pixels is selected at a location in the second image corresponding to an equivalent 
location in the first image of the first group of pixels. 
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1 32. The computer-implemented method of Claim 28, wherein the intensity level 

2 comprises grayscale values. 

7 33. The computer-implemented method of Claim 27, wherein the step of 

2 removing distortions from the pair of stereo images comprises the substeps of: 

3 removing depth plane curvature amongst the first and second images; and 

4 removing keystone distortion amongst the first and second images. 

; 34. The computer-implemented method of Claim 33, wherein the substep of 

2 removing depth plane curvature comprises the further substeps of: 

3 determining a representation of the pair of stereo images, the representation 

4 having a parallel geometry with respect to one or more X-ray sources 

5 used to form the radiographs; and 

S 6 determining pixel values for the representation based on the plurality of pixels in 

7 the pair of stereo images. 

y, ; 35. The computer-implemented method of Claim 33, wherein the substep of 

2 removing keystone distortion comprises the substeps of: 

3 determining epipolar geometry amongst the pair of stereo images; and 

4 shifting the pixels to remove the keystone distortion based on the epipolar 

5 geometry determined. 

1 36. The computer-implemented method of Claim 27, wherein the step of 

2 adjusting a corresponding screen parallax for a composite image comprises the substeps 

3 of: 
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4 displaying the pair of stereo images on a display device, the display device 

5 including a viewing surface; and 

6 locating the object near the viewing surface in order to minimize depth range. 

1 37. A system for stereo image processing of an object, said system comprising: 

2 obtaining means for obtaining at least one pair of stereo images, the stereo 

3 images being a digital representation of a corresponding pair of stereo 

4 radiographs taken of the object, the pair of stereo images including a 

5 first image and a second image both having a plurality of pixels; 

6 communicatively coupled to the obtaining means, means for correcting 

7 illumination errors within the pair of stereo images; 

8 coupled to the means for correcting illumination errors, means for removing 

9 distortions from the pair of stereo images; and 

10 coupled to the means for removing distortions, means for adjusting a 

11 corresponding screen parallax for a composite image, the composite 

12 image being a combination of the pixels of the first and second 

13 images. 

1 38. The system of Claim 37, wherein the obtaining means comprises an X-ray 

2 imaging device for providing the pair of stereo radiographs. 

/ 39. The system of Claim 38, wherein the obtaining means further comprises a 

2 converter coupled to the X-ray imaging device, the converter for converting the pair of 

3 stereo radiographs into the pair of stereo images. 

/ 40. The system of Claim 37, wherein the obtaining means comprises an X-ray 

2 imaging device for providing the pair of stereo images. 
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1 41 . The system of Claim 37, further comprising: 

2 coupled to the obtaining means, processing means for processing data 

3 representing the stereo images; 

4 coupled to the processor, a storage device; 

5 coupled to the processor, a computer readable medium; and 

6 coupled to the processor, a display device for displaying the composite image. 

1 42. The system of Claim 37, wherein the means for correcting illumination 
\i 2 errors comprises: 



^1 



3 means for selecting a first group of pixels from the first image and for selecting a 

4 second group of pixels from the second image, the second group of 
s 5 . pixels being associated with the first group of pixels; 

*=J ■ 

M 1 6 coupled to the means for selecting the first group and second group of pixels, 

CS. 

p 7 means for determining an intensity level for each pixel in both groups 

8 of pixels; 

9 coupled to the means for determining an intensity level, means for determining a 

10 mean intensity level and a variance for each of the groups of pixels; 

11 and 

12 coupled to the means for determining a mean intensity level and a variance, 

13 altering means for altering the intensity level of the pixels of the first 

14 group to approximate the intensity level of the pixels in the second 

15 group. 
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1 43. The system of Claim 37, wherein the means for removing distortions from 

2 the pair of stereo images comprises: 

3 means for rotating the first and second images to eliminating depth plane 

4 curvature therewithin; and 

5 coupled to the means for eliminating depth plane curvature, means for 

6 eliminating keystone distortion within the pair of stereo images. 

/ 44. The system of Claim 43, wherein the means for eliminating keystone 

2 distortion within the pair of stereo images comprises: 

3 means for calculating a shift amount for eliminating the keystone distortion; and 

4 coupled to the means for calculating a shift amount, means for moving the pixels 

5 of the first and second images towards each other by the calculated 

6 shift amount. 

1 45. The system of Claim 43, wherein the means for eliminating keystone 

2 distortion within the pair of stereo images comprises: 

3 means for determining a location of at least one physical pointer around the 

4 object, wherein the physical pointer is captured in the pair of stereo 

5 radiographs; 

6 coupled to the means for determining a location, estimating means for estimating 

7 epipolar geometry and horizontal and vertical distortions using the 

8 location; 
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coupled to the estimating means, adjusting means for adjusting at least one of the 
pair of stereo images vertically and horizontally to correct for any 
estimated distortions; and 

coupled to the adjusting means, means for calculating a location of the item. 

46. A computer readable medium containing a computer program product for 
stereo image processing of an object, the computer program product including 
instructions for directing a computer to execute operations comprising the steps of: 

correcting errors resulting from at least one differently illuminated pair of stereo 
images of the object, said stereo images including a plurality of pixels 
and corresponding to a pair of stereo radiographs of the object; 

removing depth plane curvature and keystone distortions from the pair of stereo 



adjusting a corresponding screen parallax for a composite image, the composite 



47. The computer readable medium of Claim 46, wherein the operations further 
comprise the steps of: 

displaying the composite image on a display device, the display device including 



locating the object appearing in the composite image near the viewing surface in 



48. A computer-readable medium comprising a computer program for correcting 
illumination errors within a pair of stereo images, wherein the pair of stereo images 
comprises a plurality of pixels, for removing distortions from the pair of stereo images, 



images; and 



image being a combination of the pair of stereo images. 



a viewing surface; and 



order to minimize depth range. 
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and for adjusting a corresponding screen parallax for a composite image, the composite 
image being a combination of the pixels in the pair of stereo images. 
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